Apache intermittent crash - HELP!!!

--000e0cd25ac24ff8ee047adae1a7
Content-Type: text/plain; charset=ISO-8859-1

Dear all,

1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4 CPU
3.00GHz GNU/Linux
2. The below info are my machine config and log output
3. Kindly advise how to resolve intermittent apache crash even after
performance tuning

*httpd.conf output
*# prefork MPM [DEFAULT IF USE=-threads]
# StartServers: number of server processes to start
# MinSpareServers: minimum number of server processes which are kept spare
# MaxSpareServers: maximum number of server processes which are kept spare
# MaxClients: maximum number of server processes allowed to start
# MaxRequestsPerChild: maximum number of requests a server process serves

StartServers 2
MinSpareServers 4
MaxSpareServers 6
MaxClients 100
MaxRequestsPerChild 500


# worker MPM [DEFAULT IF USE=threads]
# StartServers: initial number of server processes to start
# MaxClients: maximum number of simultaneous client connections
# MinSpareThreads: minimum number of worker threads which are kept spare
# MaxSpareThreads: maximum number of worker threads which are kept spare
# ThreadsPerChild: constant number of worker threads in each server process
# MaxRequestsPerChild: maximum number of requests a server process serves

StartServers 2
MaxClients 100
MinSpareThreads 25
MaxSpareThreads 75
ThreadsPerChild 25
MaxRequestsPerChild 500




*top output
*top - 00:09:00 up 157 days, 23:12, 2 users, load average: 0.67, 0.85,
0.80
Tasks: 47 total, 1 running, 46 sleeping, 0 stopped, 0 zombie
Cpu(s): 8.3% us, 1.4% sy, 0.0% ni, 88.0% id, 2.2% wa, 0.0% hi, 0.0% si
Mem: 917652k total, 858880k used, 58772k free, 142820k buffers
Swap: 1048568k total, 37844k used, 1010724k free, 434476k cached

*apache2 error log
**** glibc detected *** /usr/sbin/apache2: double free or corruption
(fasttop): 0x08b4faf0 ***
[Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting,
consider raising the MaxClients setting
*** glibc detected *** /usr/sbin/apache2: double free or corruption
(fasttop): 0x086a1170 ***
*** glibc detected *** /usr/sbin/apache2: double free or corruption
(fasttop): 0x08b48c08 ***
[Wed Dec 16 23:53:07 2009] [warn] child process 1325 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:07 2009] [warn] child process 19910 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:07 2009] [warn] child process 10569 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:07 2009] [warn] child process 16964 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:07 2009] [warn] child process 19718 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:09 2009] [warn] child process 1325 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:09 2009] [warn] child process 19910 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:09 2009] [warn] child process 10569 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:09 2009] [warn] child process 16964 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:09 2009] [warn] child process 19718 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:11 2009] [warn] child process 1325 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:11 2009] [warn] child process 19910 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:11 2009] [warn] child process 10569 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:11 2009] [warn] child process 16964 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:11 2009] [warn] child process 19718 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:13 2009] [error] child process 1325 still did not exit,
sending a SIGKILL
[Wed Dec 16 23:53:13 2009] [error] child process 19910 still did not exit,
sending a SIGKILL
[Wed Dec 16 23:53:13 2009] [error] child process 10569 still did not exit,
sending a SIGKILL
[Wed Dec 16 23:53:13 2009] [error] child process 16964 still did not exit,
sending a SIGKILL


*Joomla / PHP / Apache
*System Information
*PHP built On:* Linux trillian 2.6.16.29-ab1-xenU #1 SMP Sat Sep 23
19:20:15 SGT 2006 i686 *Database Version:* 5.0.24a-log *PHP
Version:* 5.1.6-pl4-gentoo
*Web Server:* Apache *WebServer to PHP interface:* apache2handler
*Joomla!
Version:* Joomla! 1.0.15 Stable [ Daytime ] 22 February 2008 23:00 UTC *User
Agent:* Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.15)
Gecko/2009101601 Firefox/3.0.15 (.NET CLR 3.5.30729)

*Mysql
*mysql Ver 14.12 Distrib 5.0.24a, for pc-linux-gnu (i686) using readline
5.1

--000e0cd25ac24ff8ee047adae1a7
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Dear all,

1. I'm using Linux 2.6.16.29 and running on i686 Intel=
(R) Pentium(R) 4 CPU 3.00GHz GNU/Linux
2. The below info are my machine =
config and log output
3. Kindly advise how to resolve intermittent apach=
e crash even after performance tuning


httpd.conf output
# prefork MPM [DEFAULT IF USE=3D-threads] r># StartServers: number of server processes to start
# MinSpareServers:=
minimum number of server processes which are kept spare
# MaxSpareServe=
rs: maximum number of server processes which are kept spare

# MaxClients: maximum number of server processes allowed to start
# MaxR=
equestsPerChild: maximum number of requests a server process serves
<=
IfModule prefork.c>
  =A0 StartServers         2<=
br>  =A0 MinSpareServers    =A0 4

  =A0 MaxSpareServers     6
  =A0 MaxClients    =
     100
  =A0 MaxRequestsPerChild=A0 500
</IfModule&g=
t;

# worker MPM [DEFAULT IF USE=3Dthreads]
# StartServers: initia=
l number of server processes to start
# MaxClients: maximum number of si=
multaneous client connections

# MinSpareThreads: minimum number of worker threads which are kept spare ># MaxSpareThreads: maximum number of worker threads which are kept spare r># ThreadsPerChild: constant number of worker threads in each server proce=
ss

# MaxRequestsPerChild: maximum number of requests a server process serves r><IfModule worker.c>
  =A0 StartServers      =A0=
=A0 2
  =A0 MaxClients         100
  =A0 MinS=
pareThreads     25
  =A0 MaxSpareThreads     75

  =A0 ThreadsPerChild     25
  =A0 MaxRequestsPerChild=
=A0 500
</IfModule>



top output
top - 00:0=
9:00 up 157 days, 23:12,=A0 2 users,=A0 load average: 0.67, 0.85, 0.80
T=
asks:=A0 47 total,   1 running,=A0 46 sleeping,   0 stopped,   =
0 zombie

Cpu(s):=A0 8.3% us,=A0 1.4% sy,=A0 0.0% ni, 88.0% id,=A0 2.2% wa,=A0 0.0% h=
i,=A0 0.0% si
Mem:  =A0 917652k total,   858880k used,  =A0 =
58772k free,   142820k buffers
Swap:=A0 1048568k total,  =A0 378=
44k used,=A0 1010724k free,   434476k cached


apache2 error log
*** glibc detected *** /usr/sbin/apache2: d=
ouble free or corruption (fasttop): 0x08b4faf0 ***
[Tue Dec 15 13:04:22 =
2009] [error] server reached MaxClients setting, consider raising the MaxCl=
ients setting

*** glibc detected *** /usr/sbin/apache2: double free or corruption (fastto=
p): 0x086a1170 ***
*** glibc detected *** /usr/sbin/apache2: double free=
or corruption (fasttop): 0x08b48c08 ***
[Wed Dec 16 23:53:07 2009] [war=
n] child process 1325 still did not exit, sending a SIGTERM

[Wed Dec 16 23:53:07 2009] [warn] child process 19910 still did not exit, s=
ending a SIGTERM
[Wed Dec 16 23:53:07 2009] [warn] child process 10569 s=
till did not exit, sending a SIGTERM
[Wed Dec 16 23:53:07 2009] [warn] c=
hild process 16964 still did not exit, sending a SIGTERM

[Wed Dec 16 23:53:07 2009] [warn] child process 19718 still did not exit, s=
ending a SIGTERM
[Wed Dec 16 23:53:09 2009] [warn] child process 1325 st=
ill did not exit, sending a SIGTERM
[Wed Dec 16 23:53:09 2009] [warn] ch=
ild process 19910 still did not exit, sending a SIGTERM

[Wed Dec 16 23:53:09 2009] [warn] child process 10569 still did not exit, s=
ending a SIGTERM
[Wed Dec 16 23:53:09 2009] [warn] child process 16964 s=
till did not exit, sending a SIGTERM
[Wed Dec 16 23:53:09 2009] [warn] c=
hild process 19718 still did not exit, sending a SIGTERM

[Wed Dec 16 23:53:11 2009] [warn] child process 1325 still did not exit, se=
nding a SIGTERM
[Wed Dec 16 23:53:11 2009] [warn] child process 19910 st=
ill did not exit, sending a SIGTERM
[Wed Dec 16 23:53:11 2009] [warn] ch=
ild process 10569 still did not exit, sending a SIGTERM

[Wed Dec 16 23:53:11 2009] [warn] child process 16964 still did not exit, s=
ending a SIGTERM
[Wed Dec 16 23:53:11 2009] [warn] child process 19718 s=
till did not exit, sending a SIGTERM
[Wed Dec 16 23:53:13 2009] [error] =
child process 1325 still did not exit, sending a SIGKILL

[Wed Dec 16 23:53:13 2009] [error] child process 19910 still did not exit, =
sending a SIGKILL
[Wed Dec 16 23:53:13 2009] [error] child process 10569=
still did not exit, sending a SIGKILL
[Wed Dec 16 23:53:13 2009] [error=
] child process 16964 still did not exit, sending a SIGKILL



Joomla / PHP / Apache

Re: Apache intermittent crash - HELP!!!

On Wed, Dec 16, 2009 at 4:20 PM, gary lim wrote:
>
> Dear all,
>
> 1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4 CP=
U 3.00GHz GNU/Linux
> 2. The below info are my machine config and log output
> 3. Kindly advise how to resolve intermittent apache crash even after perf=
ormance tuning
>
> httpd.conf output
> # prefork MPM [DEFAULT IF USE=3D-threads]
> # StartServers: number of server processes to start
> # MinSpareServers: minimum number of server processes which are kept spar=
e
> # MaxSpareServers: maximum number of server processes which are kept spar=
e
> # MaxClients: maximum number of server processes allowed to start
> # MaxRequestsPerChild: maximum number of requests a server process serves
>
>     StartServers       =
  2
>     MinSpareServers      4
>     MaxSpareServers     6
>     MaxClients       =
  100
>     MaxRequestsPerChild  500
>
>
> # worker MPM [DEFAULT IF USE=3Dthreads]
> # StartServers: initial number of server processes to start
> # MaxClients: maximum number of simultaneous client connections
> # MinSpareThreads: minimum number of worker threads which are kept spare
> # MaxSpareThreads: maximum number of worker threads which are kept spare
> # ThreadsPerChild: constant number of worker threads in each server proce=
ss
> # MaxRequestsPerChild: maximum number of requests a server process serves
>
>     StartServers       =
  2
>     MaxClients       =
  100
>     MinSpareThreads     25
>     MaxSpareThreads     75
>     ThreadsPerChild     25
>     MaxRequestsPerChild  500
>
>
>
>
> top output
> top - 00:09:00 up 157 days, 23:12,  2 users,  load average: 0.6=
7, 0.85, 0.80
> Tasks:  47 total,   1 running,  46 sleeping, =C2=
=A0 0 stopped,   0 zombie
> Cpu(s):  8.3% us,  1.4% sy,  0.0% ni, 88.0% id,  2.2%=
wa,  0.0% hi,  0.0% si
> Mem:    917652k total,   858880k used, =C2=
 Â=A0 58772k free,   142820k buffers
> Swap:  1048568k total,    37844k used,  1010724k=
free,   434476k cached
>
> apache2 error log
> *** glibc detected *** /usr/sbin/apache2: double free or corruption (fast=
top): 0x08b4faf0 ***
> [Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting, con=
sider raising the MaxClients setting
> *** glibc detected *** /usr/sbin/apache2: double free or corruption (fast=
top): 0x086a1170 ***
> *** glibc detected *** /usr/sbin/apache2: double free or corruption (fast=
top): 0x08b48c08 ***
> [Wed Dec 16 23:53:07 2009] [warn] child process 1325 still did not exit, =
sending a SIGTERM
> [Wed Dec 16 23:53:07 2009] [warn] child process 19910 still did not exit,=
sending a SIGTERM
> [Wed Dec 16 23:53:07 2009] [warn] child process 10569 still did not exit,=
sending a SIGTERM
> [Wed Dec 16 23:53:07 2009] [warn] child process 16964 still did not exit,=
sending a SIGTERM
> [Wed Dec 16 23:53:07 2009] [warn] child process 19718 still did not exit,=
sending a SIGTERM
> [Wed Dec 16 23:53:09 2009] [warn] child process 1325 still did not exit, =
sending a SIGTERM
> [Wed Dec 16 23:53:09 2009] [warn] child process 19910 still did not exit,=
sending a SIGTERM
> [Wed Dec 16 23:53:09 2009] [warn] child process 10569 still did not exit,=
sending a SIGTERM
> [Wed Dec 16 23:53:09 2009] [warn] child process 16964 still did not exit,=
sending a SIGTERM
> [Wed Dec 16 23:53:09 2009] [warn] child process 19718 still did not exit,=
sending a SIGTERM
> [Wed Dec 16 23:53:11 2009] [warn] child process 1325 still did not exit, =
sending a SIGTERM
> [Wed Dec 16 23:53:11 2009] [warn] child process 19910 still did not exit,=
sending a SIGTERM
> [Wed Dec 16 23:53:11 2009] [warn] child process 10569 still did not exit,=
sending a SIGTERM
> [Wed Dec 16 23:53:11 2009] [warn] child process 16964 still did not exit,=
sending a SIGTERM
> [Wed Dec 16 23:53:11 2009] [warn] child process 19718 still did not exit,=
sending a SIGTERM
> [Wed Dec 16 23:53:13 2009] [error] child process 1325 still did not exit,=
sending a SIGKILL
> [Wed Dec 16 23:53:13 2009] [error] child process 19910 still did not exit=
, sending a SIGKILL
> [Wed Dec 16 23:53:13 2009] [error] child process 10569 still did not exit=
, sending a SIGKILL
> [Wed Dec 16 23:53:13 2009] [error] child process 16964 still did not exit=
, sending a SIGKILL
>
>
> Joomla / PHP / Apache
> System Information
> PHP built On: Linux trillian 2.6.16.29-ab1-xenU #1 SMP Sat Sep 23 19:20:1=
5 SGT 2006 i686
> Database Version: 5.0.24a-log
> PHP Version: 5.1.6-pl4-gentoo
> Web Server: Apache
> WebServer to PHP interface: apache2handler
> Joomla! Version: Joomla! 1.0.15 Stable [ Daytime ] 22 February 2008 23:00=
UTC
> User Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.15) =
Gecko/2009101601 Firefox/3.0.15 (.NET CLR 3.5.30729)
>
> Mysql
> mysql  Ver 14.12 Distrib 5.0.24a, for pc-linux-gnu (i686) using read=
line 5.1
>

Does it work if you disable PHP? Does it still exhibit problems if you
run PHP out of process, eg using fastcgi or scgi (can PHP talk SCGI?).
For my money, the double free()s are coming from PHP or a PHP module.

Cheers

Tom

------------------------------------------------------------ ---------
The official User-To-User support forum of the Apache HTTP Server Project.
See for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org

Re: Apache intermittent crash - HELP!!!

On 16 Dec 2009, at 16:20, gary lim wrote:

> Dear all,
>
> 1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4 CPU 3.00GHz GNU/Linux

but no sign of your APR and Apache versions.

--
Nick Kew

------------------------------------------------------------ ---------
The official User-To-User support forum of the Apache HTTP Server Project.
See for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org

Re: Apache intermittent crash - HELP!!!

--000e0cd348581ab64c047ae278f6
Content-Type: text/plain; charset=ISO-8859-1

Hi,

1. Unfortunately, our website depend heavily on PHP to operate, so it not
possible for us to disable it. We also highly suspect that the crash is
related to one of our php module because we are running a lot of Joomla
component.

2. unfortunately, we are unable to track which module is causing this issue.
Any idea how we can check which script is causing the problem because this
has been going on for weeks and we are still unable to determine the source.

3. Kindly advise how we can perform the migration of our existing codebase
to FastCGI/SCGI without breaking the current website?


rgds


On Thu, Dec 17, 2009 at 12:28 AM, Tom Evans wrote:

> On Wed, Dec 16, 2009 at 4:20 PM, gary lim wrote:
> >
> > Dear all,
> >
> > 1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4
> CPU 3.00GHz GNU/Linux
> > 2. The below info are my machine config and log output
> > 3. Kindly advise how to resolve intermittent apache crash even after
> performance tuning
> >
> > httpd.conf output
> > # prefork MPM [DEFAULT IF USE=-threads]
> > # StartServers: number of server processes to start
> > # MinSpareServers: minimum number of server processes which are kept
> spare
> > # MaxSpareServers: maximum number of server processes which are kept
> spare
> > # MaxClients: maximum number of server processes allowed to start
> > # MaxRequestsPerChild: maximum number of requests a server process serves
> >
> > StartServers 2
> > MinSpareServers 4
> > MaxSpareServers 6
> > MaxClients 100
> > MaxRequestsPerChild 500
> >
> >
> > # worker MPM [DEFAULT IF USE=threads]
> > # StartServers: initial number of server processes to start
> > # MaxClients: maximum number of simultaneous client connections
> > # MinSpareThreads: minimum number of worker threads which are kept spare
> > # MaxSpareThreads: maximum number of worker threads which are kept spare
> > # ThreadsPerChild: constant number of worker threads in each server
> process
> > # MaxRequestsPerChild: maximum number of requests a server process serves
> >
> > StartServers 2
> > MaxClients 100
> > MinSpareThreads 25
> > MaxSpareThreads 75
> > ThreadsPerChild 25
> > MaxRequestsPerChild 500
> >
> >
> >
> >
> > top output
> > top - 00:09:00 up 157 days, 23:12, 2 users, load average: 0.67, 0.85,
> 0.80
> > Tasks: 47 total, 1 running, 46 sleeping, 0 stopped, 0 zombie
> > Cpu(s): 8.3% us, 1.4% sy, 0.0% ni, 88.0% id, 2.2% wa, 0.0% hi, 0.0%
> si
> > Mem: 917652k total, 858880k used, 58772k free, 142820k buffers
> > Swap: 1048568k total, 37844k used, 1010724k free, 434476k cached
> >
> > apache2 error log
> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
> (fasttop): 0x08b4faf0 ***
> > [Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting,
> consider raising the MaxClients setting
> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
> (fasttop): 0x086a1170 ***
> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
> (fasttop): 0x08b48c08 ***
> > [Wed Dec 16 23:53:07 2009] [warn] child process 1325 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:07 2009] [warn] child process 19910 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:07 2009] [warn] child process 10569 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:07 2009] [warn] child process 16964 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:07 2009] [warn] child process 19718 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:09 2009] [warn] child process 1325 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:09 2009] [warn] child process 19910 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:09 2009] [warn] child process 10569 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:09 2009] [warn] child process 16964 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:09 2009] [warn] child process 19718 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:11 2009] [warn] child process 1325 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:11 2009] [warn] child process 19910 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:11 2009] [warn] child process 10569 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:11 2009] [warn] child process 16964 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:11 2009] [warn] child process 19718 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:13 2009] [error] child process 1325 still did not exit,
> sending a SIGKILL
> > [Wed Dec 16 23:53:13 2009] [error] child process 19910 still did not
> exit, sending a SIGKILL
> > [Wed Dec 16 23:53:13 2009] [error] child process 10569 still did not
> exit, sending a SIGKILL
> > [Wed Dec 16 23:53:13 2009] [error] child process 16964 still did not
> exit, sending a SIGKILL
> >
> >
> > Joomla / PHP / Apache
> > System Information
> > PHP built On: Linux trillian 2.6.16.29-ab1-xenU #1 SMP Sat Sep 23
> 19:20:15 SGT 2006 i686
> > Database Version: 5.0.24a-log
> > PHP Version: 5.1.6-pl4-gentoo
> > Web Server: Apache
> > WebServer to PHP interface: apache2handler
> > Joomla! Version: Joomla! 1.0.15 Stable [ Daytime ] 22 February 2008 23:00
> UTC
> > User Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.15)
> Gecko/2009101601 Firefox/3.0.15 (.NET CLR 3.5.30729)
> >
> > Mysql
> > mysql Ver 14.12 Distrib 5.0.24a, for pc-linux-gnu (i686) using readline
> 5.1
> >
>
> Does it work if you disable PHP? Does it still exhibit problems if you
> run PHP out of process, eg using fastcgi or scgi (can PHP talk SCGI?).
> For my money, the double free()s are coming from PHP or a PHP module.
>
> Cheers
>
> Tom
>
> ------------------------------------------------------------ ---------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> " from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>

--000e0cd348581ab64c047ae278f6
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hi,

1. Unfortunately, our website depend heavily on PHP to operate, =
so it not possible for us to disable it. We also highly suspect that the cr=
ash is related to one of our php module because we are running a lot of Joo=
mla component.


2. unfortunately, we are unable to track which module is causing this i=
ssue. Any idea how we can check which script is causing the problem because=
this has been going on for weeks and we are still unable to determine the =
source.


3. Kindly advise how we can perform the migration of our existing codeb=
ase to FastCGI/SCGI without breaking the current website?


rgds r>

Re: Apache intermittent crash - HELP!!!

--000e0cd60b12fa5fe0047ae32a47
Content-Type: text/plain; charset=ISO-8859-1

Gary:

The same thing happened to one of my servers. After long research I got to
the conclusion that the problem was caused by the XCache module. If you have
it, try to disable it.


Rodrigo

2009/12/16 gary lim

> Hi,
>
> 1. Unfortunately, our website depend heavily on PHP to operate, so it not
> possible for us to disable it. We also highly suspect that the crash is
> related to one of our php module because we are running a lot of Joomla
> component.
>
> 2. unfortunately, we are unable to track which module is causing this
> issue. Any idea how we can check which script is causing the problem because
> this has been going on for weeks and we are still unable to determine the
> source.
>
> 3. Kindly advise how we can perform the migration of our existing codebase
> to FastCGI/SCGI without breaking the current website?
>
>
> rgds
>
>
> On Thu, Dec 17, 2009 at 12:28 AM, Tom Evans wrote:
>
>> On Wed, Dec 16, 2009 at 4:20 PM, gary lim wrote:
>> >
>> > Dear all,
>> >
>> > 1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4
>> CPU 3.00GHz GNU/Linux
>> > 2. The below info are my machine config and log output
>> > 3. Kindly advise how to resolve intermittent apache crash even after
>> performance tuning
>> >
>> > httpd.conf output
>> > # prefork MPM [DEFAULT IF USE=-threads]
>> > # StartServers: number of server processes to start
>> > # MinSpareServers: minimum number of server processes which are kept
>> spare
>> > # MaxSpareServers: maximum number of server processes which are kept
>> spare
>> > # MaxClients: maximum number of server processes allowed to start
>> > # MaxRequestsPerChild: maximum number of requests a server process
>> serves
>> >
>> > StartServers 2
>> > MinSpareServers 4
>> > MaxSpareServers 6
>> > MaxClients 100
>> > MaxRequestsPerChild 500
>> >
>> >
>> > # worker MPM [DEFAULT IF USE=threads]
>> > # StartServers: initial number of server processes to start
>> > # MaxClients: maximum number of simultaneous client connections
>> > # MinSpareThreads: minimum number of worker threads which are kept spare
>> > # MaxSpareThreads: maximum number of worker threads which are kept spare
>> > # ThreadsPerChild: constant number of worker threads in each server
>> process
>> > # MaxRequestsPerChild: maximum number of requests a server process
>> serves
>> >
>> > StartServers 2
>> > MaxClients 100
>> > MinSpareThreads 25
>> > MaxSpareThreads 75
>> > ThreadsPerChild 25
>> > MaxRequestsPerChild 500
>> >
>> >
>> >
>> >
>> > top output
>> > top - 00:09:00 up 157 days, 23:12, 2 users, load average: 0.67, 0.85,
>> 0.80
>> > Tasks: 47 total, 1 running, 46 sleeping, 0 stopped, 0 zombie
>> > Cpu(s): 8.3% us, 1.4% sy, 0.0% ni, 88.0% id, 2.2% wa, 0.0% hi,
>> 0.0% si
>> > Mem: 917652k total, 858880k used, 58772k free, 142820k buffers
>> > Swap: 1048568k total, 37844k used, 1010724k free, 434476k cached
>> >
>> > apache2 error log
>> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
>> (fasttop): 0x08b4faf0 ***
>> > [Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting,
>> consider raising the MaxClients setting
>> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
>> (fasttop): 0x086a1170 ***
>> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
>> (fasttop): 0x08b48c08 ***
>> > [Wed Dec 16 23:53:07 2009] [warn] child process 1325 still did not exit,
>> sending a SIGTERM
>> > [Wed Dec 16 23:53:07 2009] [warn] child process 19910 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:07 2009] [warn] child process 10569 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:07 2009] [warn] child process 16964 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:07 2009] [warn] child process 19718 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:09 2009] [warn] child process 1325 still did not exit,
>> sending a SIGTERM
>> > [Wed Dec 16 23:53:09 2009] [warn] child process 19910 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:09 2009] [warn] child process 10569 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:09 2009] [warn] child process 16964 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:09 2009] [warn] child process 19718 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:11 2009] [warn] child process 1325 still did not exit,
>> sending a SIGTERM
>> > [Wed Dec 16 23:53:11 2009] [warn] child process 19910 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:11 2009] [warn] child process 10569 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:11 2009] [warn] child process 16964 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:11 2009] [warn] child process 19718 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:13 2009] [error] child process 1325 still did not
>> exit, sending a SIGKILL
>> > [Wed Dec 16 23:53:13 2009] [error] child process 19910 still did not
>> exit, sending a SIGKILL
>> > [Wed Dec 16 23:53:13 2009] [error] child process 10569 still did not
>> exit, sending a SIGKILL
>> > [Wed Dec 16 23:53:13 2009] [error] child process 16964 still did not
>> exit, sending a SIGKILL
>> >
>> >
>> > Joomla / PHP / Apache
>> > System Information
>> > PHP built On: Linux trillian 2.6.16.29-ab1-xenU #1 SMP Sat Sep 23
>> 19:20:15 SGT 2006 i686
>> > Database Version: 5.0.24a-log
>> > PHP Version: 5.1.6-pl4-gentoo
>> > Web Server: Apache
>> > WebServer to PHP interface: apache2handler
>> > Joomla! Version: Joomla! 1.0.15 Stable [ Daytime ] 22 February 2008
>> 23:00 UTC
>> > User Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.15)
>> Gecko/2009101601 Firefox/3.0.15 (.NET CLR 3.5.30729)
>> >
>> > Mysql
>> > mysql Ver 14.12 Distrib 5.0.24a, for pc-linux-gnu (i686) using readline
>> 5.1
>> >
>>
>> Does it work if you disable PHP? Does it still exhibit problems if you
>> run PHP out of process, eg using fastcgi or scgi (can PHP talk SCGI?).
>> For my money, the double free()s are coming from PHP or a PHP module.
>>
>> Cheers
>>
>> Tom
>>
>> ------------------------------------------------------------ ---------
>> The official User-To-User support forum of the Apache HTTP Server Project.
>> See for more info.
>> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>> " from the digest: users-digest-unsubscribe@httpd.apache.org
>> For additional commands, e-mail: users-help@httpd.apache.org
>>
>>
>


--
Rodrigo Aliste P.

--000e0cd60b12fa5fe0047ae32a47
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Gary:

The same thing happened to one of my servers. After long resea=
rch I got to the conclusion that the problem was caused by the XCache modul=
e. If you have it, try to disable it.


Rodrigo

Re: Apache intermittent crash - HELP!!!

--000e0cd7618088ff0a047ae33ade
Content-Type: text/plain; charset=ISO-8859-1

I just noticed that your error log shows:

[Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting,
consider raising the MaxClients setting

so try adjusting your MaxClient setting and your prefork settings. (
http://httpd.apache.org/docs/2.0/mod/prefork.html)

I'm not an expert on tuning those settings, but I'm sure someone else here
could help you.


2009/12/16 Rodrigo Aliste P.

> Gary:
>
> The same thing happened to one of my servers. After long research I got to
> the conclusion that the problem was caused by the XCache module. If you have
> it, try to disable it.
>
>
> Rodrigo
>
> 2009/12/16 gary lim
>
> Hi,
>>
>> 1. Unfortunately, our website depend heavily on PHP to operate, so it not
>> possible for us to disable it. We also highly suspect that the crash is
>> related to one of our php module because we are running a lot of Joomla
>> component.
>>
>> 2. unfortunately, we are unable to track which module is causing this
>> issue. Any idea how we can check which script is causing the problem because
>> this has been going on for weeks and we are still unable to determine the
>> source.
>>
>> 3. Kindly advise how we can perform the migration of our existing codebase
>> to FastCGI/SCGI without breaking the current website?
>>
>>
>> rgds
>>
>>
>> On Thu, Dec 17, 2009 at 12:28 AM, Tom Evans wrote:
>>
>>> On Wed, Dec 16, 2009 at 4:20 PM, gary lim wrote:
>>> >
>>> > Dear all,
>>> >
>>> > 1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4
>>> CPU 3.00GHz GNU/Linux
>>> > 2. The below info are my machine config and log output
>>> > 3. Kindly advise how to resolve intermittent apache crash even after
>>> performance tuning
>>> >
>>> > httpd.conf output
>>> > # prefork MPM [DEFAULT IF USE=-threads]
>>> > # StartServers: number of server processes to start
>>> > # MinSpareServers: minimum number of server processes which are kept
>>> spare
>>> > # MaxSpareServers: maximum number of server processes which are kept
>>> spare
>>> > # MaxClients: maximum number of server processes allowed to start
>>> > # MaxRequestsPerChild: maximum number of requests a server process
>>> serves
>>> >
>>> > StartServers 2
>>> > MinSpareServers 4
>>> > MaxSpareServers 6
>>> > MaxClients 100
>>> > MaxRequestsPerChild 500
>>> >
>>> >
>>> > # worker MPM [DEFAULT IF USE=threads]
>>> > # StartServers: initial number of server processes to start
>>> > # MaxClients: maximum number of simultaneous client connections
>>> > # MinSpareThreads: minimum number of worker threads which are kept
>>> spare
>>> > # MaxSpareThreads: maximum number of worker threads which are kept
>>> spare
>>> > # ThreadsPerChild: constant number of worker threads in each server
>>> process
>>> > # MaxRequestsPerChild: maximum number of requests a server process
>>> serves
>>> >
>>> > StartServers 2
>>> > MaxClients 100
>>> > MinSpareThreads 25
>>> > MaxSpareThreads 75
>>> > ThreadsPerChild 25
>>> > MaxRequestsPerChild 500
>>> >
>>> >
>>> >
>>> >
>>> > top output
>>> > top - 00:09:00 up 157 days, 23:12, 2 users, load average: 0.67, 0.85,
>>> 0.80
>>> > Tasks: 47 total, 1 running, 46 sleeping, 0 stopped, 0 zombie
>>> > Cpu(s): 8.3% us, 1.4% sy, 0.0% ni, 88.0% id, 2.2% wa, 0.0% hi,
>>> 0.0% si
>>> > Mem: 917652k total, 858880k used, 58772k free, 142820k
>>> buffers
>>> > Swap: 1048568k total, 37844k used, 1010724k free, 434476k cached
>>> >
>>> > apache2 error log
>>> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
>>> (fasttop): 0x08b4faf0 ***
>>> > [Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting,
>>> consider raising the MaxClients setting
>>> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
>>> (fasttop): 0x086a1170 ***
>>> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
>>> (fasttop): 0x08b48c08 ***
>>> > [Wed Dec 16 23:53:07 2009] [warn] child process 1325 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:07 2009] [warn] child process 19910 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:07 2009] [warn] child process 10569 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:07 2009] [warn] child process 16964 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:07 2009] [warn] child process 19718 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:09 2009] [warn] child process 1325 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:09 2009] [warn] child process 19910 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:09 2009] [warn] child process 10569 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:09 2009] [warn] child process 16964 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:09 2009] [warn] child process 19718 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:11 2009] [warn] child process 1325 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:11 2009] [warn] child process 19910 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:11 2009] [warn] child process 10569 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:11 2009] [warn] child process 16964 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:11 2009] [warn] child process 19718 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:13 2009] [error] child process 1325 still did not
>>> exit, sending a SIGKILL
>>> > [Wed Dec 16 23:53:13 2009] [error] child process 19910 still did not
>>> exit, sending a SIGKILL
>>> > [Wed Dec 16 23:53:13 2009] [error] child process 10569 still did not
>>> exit, sending a SIGKILL
>>> > [Wed Dec 16 23:53:13 2009] [error] child process 16964 still did not
>>> exit, sending a SIGKILL
>>> >
>>> >
>>> > Joomla / PHP / Apache
>>> > System Information
>>> > PHP built On: Linux trillian 2.6.16.29-ab1-xenU #1 SMP Sat Sep 23
>>> 19:20:15 SGT 2006 i686
>>> > Database Version: 5.0.24a-log
>>> > PHP Version: 5.1.6-pl4-gentoo
>>> > Web Server: Apache
>>> > WebServer to PHP interface: apache2handler
>>> > Joomla! Version: Joomla! 1.0.15 Stable [ Daytime ] 22 February 2008
>>> 23:00 UTC
>>> > User Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US;
>>> rv:1.9.0.15) Gecko/2009101601 Firefox/3.0.15 (.NET CLR 3.5.30729)
>>> >
>>> > Mysql
>>> > mysql Ver 14.12 Distrib 5.0.24a, for pc-linux-gnu (i686) using
>>> readline 5.1
>>> >
>>>
>>> Does it work if you disable PHP? Does it still exhibit problems if you
>>> run PHP out of process, eg using fastcgi or scgi (can PHP talk SCGI?).
>>> For my money, the double free()s are coming from PHP or a PHP module.
>>>
>>> Cheers
>>>
>>> Tom
>>>
>>> ------------------------------------------------------------ ---------
>>> The official User-To-User support forum of the Apache HTTP Server
>>> Project.
>>> See for more info.
>>> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>>> " from the digest: users-digest-unsubscribe@httpd.apache.org
>>> For additional commands, e-mail: users-help@httpd.apache.org
>>>
>>>
>>
>
>
> --
> Rodrigo Aliste P.
>
>


--
Rodrigo Aliste P.

--000e0cd7618088ff0a047ae33ade
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

I just noticed that your error log shows:

[Tue Dec 15 13:04:22 2009=
] [error] server reached MaxClients setting, consider raising the MaxClient=
s setting

so try adjusting your MaxClient setting and your prefork s=
ettings. (htt=
p://httpd.apache.org/docs/2.0/mod/prefork.html)



I'm not an expert on tuning those settings, but I'm sure someon=
e else here could help you.

Re: Apache intermittent crash - HELP!!!

-->From: gary lim
-->Sent: 16 December, 2009 16:20
-->To: users@httpd.apache.org
-->Subject: [users@httpd] Apache intermittent crash - HELP!!!
-->
-->
-->Dear all,
-->
-->1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4
CPU 3.00GHz GNU/Linux
-->2. The below info are my machine config and log output
-->3. Kindly advise how to resolve intermittent apache crash even after
performance tuning
-->
-->apache2 error log
-->*** glibc detected *** /usr/sbin/apache2: double free or corruption
(fasttop): 0x08b4faf0 ***
-->[Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting,
consider raising the MaxClients setting
-->*** glibc detected *** /usr/sbin/apache2: double free or corruption
(fasttop): 0x086a1170 ***
-->*** glibc detected *** /usr/sbin/apache2: double free or corruption
(fasttop): 0x08b48c08 ***



Gary,

What version of glibc do you have? The glibc detected could be causing this
since its producing a dump code. I would revert back to a default setup
with your httpd.conf file, and just use the basics you need for your site to
run. If you get no crashes then its an issue with your performance tuning.

Thanks,
Daniel


------------------------------------------------------------ ---------
The official User-To-User support forum of the Apache HTTP Server Project.
See for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org

Re: Apache intermittent crash - HELP!!!

--000e0cd32fb626f051047ae5939d
Content-Type: text/plain; charset=ISO-8859-1

Hi daniel,

1. the intermittent crash happens even before we did any performance tuning
of the apache.

2. the reason why we did the tuning is because we want to limit the apache
memory usage which previously was due to apache using up all the swap mem
causing the crash.

rgds


On Thu, Dec 17, 2009 at 12:42 PM, Daniel Reinhardt
wrote:

> -->From: gary lim
> -->Sent: 16 December, 2009 16:20
> -->To: users@httpd.apache.org
> -->Subject: [users@httpd] Apache intermittent crash - HELP!!!
> -->
> -->
> -->Dear all,
>
> -->
> -->1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4
> CPU 3.00GHz GNU/Linux
> -->2. The below info are my machine config and log output
> -->3. Kindly advise how to resolve intermittent apache crash even after
> performance tuning
> -->
> -->apache2 error log
>
> -->*** glibc detected *** /usr/sbin/apache2: double free or corruption
> (fasttop): 0x08b4faf0 ***
> -->[Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting,
> consider raising the MaxClients setting
> -->*** glibc detected *** /usr/sbin/apache2: double free or corruption
> (fasttop): 0x086a1170 ***
> -->*** glibc detected *** /usr/sbin/apache2: double free or corruption
> (fasttop): 0x08b48c08 ***
>
>
>
> Gary,
>
> What version of glibc do you have? The glibc detected could be causing
> this since its producing a dump code. I would revert back to a default
> setup with your httpd.conf file, and just use the basics you need for your
> site to run. If you get no crashes then its an issue with your performance
> tuning.
>
> Thanks,
> Daniel
>
> ------------------------------------------------------------ ---------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> " from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>

--000e0cd32fb626f051047ae5939d
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hi daniel,

1. the intermittent crash happens even before we did any =
performance tuning of the apache.

2. the reason why we did the tunin=
g is because we want to limit the apache memory usage which previously was =
due to apache using up all the swap mem causing the crash.


rgds

Re: Apache intermittent crash - HELP!!!

------=_NextPart_000_0015_01CA7F24.6BFE2B50
Content-Type: text/plain;
charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable



From: gary lim=20
Sent: 17 December, 2009 5:05
To: users@httpd.apache.org=20
Subject: Re: [users@httpd] Apache intermittent crash - HELP!!!


Hi daniel,

1. the intermittent crash happens even before we did any performance =
tuning of the apache.

2. the reason why we did the tuning is because we want to limit the =
apache memory usage which previously was due to apache using up all the =
swap mem causing the crash.

rgds



On Thu, Dec 17, 2009 at 12:42 PM, Daniel Reinhardt =
wrote:

-->From: gary lim
-->Sent: 16 December, 2009 16:20
-->To: users@httpd.apache.org
-->Subject: [users@httpd] Apache intermittent crash - HELP!!!
-->
-->
-->Dear all,=20

-->
-->1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) =
Pentium(R) 4 CPU 3.00GHz GNU/Linux
-->2. The below info are my machine config and log output
-->3. Kindly advise how to resolve intermittent apache crash even =
after performance tuning

-->
-->apache2 error log=20

-->*** glibc detected *** /usr/sbin/apache2: double free or corruption =
(fasttop): 0x08b4faf0 ***
-->[Tue Dec 15 13:04:22 2009] [error] server reached MaxClients =
setting, consider raising the MaxClients setting
-->*** glibc detected *** /usr/sbin/apache2: double free or corruption =
(fasttop): 0x086a1170 ***
-->*** glibc detected *** /usr/sbin/apache2: double free or corruption =
(fasttop): 0x08b48c08 ***




Gary,

What version of glibc do you have? The glibc detected could be =
causing this since its producing a dump code. I would revert back to a =
default setup with your httpd.conf file, and just use the basics you =
need for your site to run. If you get no crashes then its an issue with =
your performance tuning.

Thanks,
Daniel=20


------------------------------------------------------------ ---------
The official User-To-User support forum of the Apache HTTP Server =
Project.
See for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org





Gary,

If your application is using all of the SWAP memory maybe its time to =
rebuild the system with more swap space or upgrade the RAM. Can you =
post the server specs for us? I have never seen an application take =
full use of all the memory and all the allocated swap space. You have =
hardware issues that need to be dealt with before attempting to solve =
the software ones.

When you list your system specs, can you also tell us if your Kernel has =
support for higher memory system configs?

Thanks,
Daniel
------=_NextPart_000_0015_01CA7F24.6BFE2B50
Content-Type: text/html;
charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable



http-equiv=3DContent-Type>

15px"=20
id=3DMailContainerBody leftMargin=3D0 topMargin=3D0 =
CanvasTabStop=3D"true"=20
name=3D"Compose message area">

Re: Apache intermittent crash - HELP!!!

--000e0cd3512a52d531047b070dc7
Content-Type: text/plain; charset=ISO-8859-1

Hi Daniel,

After performance tuning of apache, the mem usage is now more managable.
However, the apache still experience intermittent crash which we suspect is
due to certain PHP module running in our joomla website.

*top output
*top - 04:58:52 up 160 days, 4:02, 1 user, load average: 0.08, 0.04, 0.05
Tasks: 69 total, 2 running, 67 sleeping, 0 stopped, 0 zombie
Cpu(s): 1.9% us, 5.0% sy, 0.0% ni, 93.2% id, 0.0% wa, 0.0% hi, 0.0% si
Mem: 917652k total, 908144k used, 9508k free, 32660k buffers
Swap: 1048568k total, 37856k used, 1010712k free, 179480k cached


Model: *Dell PowerEdge 850*
CPU:Intel *Pentium IV 3.0GHz* / 2MB, 800MHz FSB
RAM: *2GB **DDR-2 SDRAM* 533MHz w/ ECC*
*Harddisk: *02 x SATA* (7200RPM) HDD (non-RAID)


*Apache Version
*Server version: Apache/2.0.58
Server built: Dec 12 2006 21:41:17

Server version: Apache/2.0.58
Server built: Dec 12 2006 21:41:17
Server's Module Magic Number: 20020903:12
Server loaded: APR 0.9.12, APR-UTIL 0.9.12
Compiled using: APR 0.9.12, APR-UTIL 0.9.12
Architecture: 32-bit
Server compiled with....
-D APACHE_MPM_DIR="server/mpm/prefork"
-D APR_HAS_SENDFILE
-D APR_HAS_MMAP
-D APR_HAVE_IPV6 (IPv4-mapped addresses enabled)
-D APR_USE_SYSVSEM_SERIALIZE
-D APR_USE_PTHREAD_SERIALIZE
-D SINGLE_LISTEN_UNSERIALIZED_ACCEPT
-D APR_HAS_OTHER_CHILD
-D AP_HAVE_RELIABLE_PIPED_LOGS
-D HTTPD_ROOT="/usr"
-D SUEXEC_BIN="/usr/sbin/suexec2"
-D DEFAULT_PIDLOG="/var/run/httpd.pid"
-D DEFAULT_SCOREBOARD="logs/apache_runtime_status"
-D DEFAULT_LOCKFILE="/var/run/accept.lock"
-D DEFAULT_ERRORLOG="logs/error_log"
-D AP_TYPES_CONFIG_FILE="/etc/apache2/mime.types"
-D SERVER_CONFIG_FILE="/etc/apache2/httpd.conf"

Compiled in modules:
core.c
prefork.c
http_core.c
mod_so.c



On Thu, Dec 17, 2009 at 10:22 PM, Daniel Reinhardt
wrote:

>
> *From:* gary lim
> *Sent:* 17 December, 2009 5:05
> *To:* users@httpd.apache.org
> *Subject:* Re: [users@httpd] Apache intermittent crash - HELP!!!
>
> Hi daniel,
>
> 1. the intermittent crash happens even before we did any performance tuning
> of the apache.
>
> 2. the reason why we did the tuning is because we want to limit the apache
> memory usage which previously was due to apache using up all the swap mem
> causing the crash.
>
> rgds
>
>
> On Thu, Dec 17, 2009 at 12:42 PM, Daniel Reinhardt <
> cryptodan@cryptodan.net> wrote:
>
>> -->From: gary lim
>> -->Sent: 16 December, 2009 16:20
>> -->To: users@httpd.apache.org
>> -->Subject: [users@httpd] Apache intermittent crash - HELP!!!
>> -->
>> -->
>> -->Dear all,
>>
>> -->
>> -->1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4
>> CPU 3.00GHz GNU/Linux
>> -->2. The below info are my machine config and log output
>> -->3. Kindly advise how to resolve intermittent apache crash even after
>> performance tuning
>> -->
>> -->apache2 error log
>>
>> -->*** glibc detected *** /usr/sbin/apache2: double free or corruption
>> (fasttop): 0x08b4faf0 ***
>> -->[Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting,
>> consider raising the MaxClients setting
>> -->*** glibc detected *** /usr/sbin/apache2: double free or corruption
>> (fasttop): 0x086a1170 ***
>> -->*** glibc detected *** /usr/sbin/apache2: double free or corruption
>> (fasttop): 0x08b48c08 ***
>>
>>
>>
>> Gary,
>>
>> What version of glibc do you have? The glibc detected could be causing
>> this since its producing a dump code. I would revert back to a default
>> setup with your httpd.conf file, and just use the basics you need for your
>> site to run. If you get no crashes then its an issue with your performance
>> tuning.
>>
>> Thanks,
>> Daniel
>>
>> ------------------------------------------------------------ ---------
>> The official User-To-User support forum of the Apache HTTP Server Project.
>> See for more info.
>> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>> " from the digest: users-digest-unsubscribe@httpd.apache.org
>> For additional commands, e-mail: users-help@httpd.apache.org
>>
>>
>
> Gary,
>
> If your application is using all of the SWAP memory maybe its time to
> rebuild the system with more swap space or upgrade the RAM. Can you post
> the server specs for us? I have never seen an application take full use of
> all the memory and all the allocated swap space. You have hardware issues
> that need to be dealt with before attempting to solve the software ones.
>
> When you list your system specs, can you also tell us if your Kernel has
> support for higher memory system configs?
>
> Thanks,
> Daniel
>

--000e0cd3512a52d531047b070dc7
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hi Daniel,

After performance tuning of apache, the mem usage is now =
more managable. However, the apache still experience intermittent crash whi=
ch we suspect is due to certain PHP module running in our joomla website. r>

top output
top - 04:58:52 up 160 days,=A0 4:02,=A0 1 user,=A0=
load average: 0.08, 0.04, 0.05
Tasks:=A0 69 total,   2 running,=A0 =
67 sleeping,   0 stopped,   0 zombie
Cpu(s):=A0 1.9% us,=A0 5.0%=
sy,=A0 0.0% ni, 93.2% id,=A0 0.0% wa,=A0 0.0% hi,=A0 0.0% si

Mem:  =A0 917652k total,   908144k used,     9508k free,=A0=
   32660k buffers
Swap:=A0 1048568k total,  =A0 37856k used,=A0 =
1010712k free,   179480k cached


Model: or=3D"#009900">Dell PowerEdge 850


CPU: ns-serif">Intel Pentium IV 3.0GHz / 2MB, 800MHz FSB
d=3D"wfx:">
RAM: ans-serif">2GB " face=3D"Helvetica, Arial, sans-serif">DDR-2 SDRAM nt> ">533MHz l, sans-serif">w/ ECC zj">


Harddisk: color=3D"#009900">02 x SATA (7200RPM) HDD (non-RAID)
=


Apache Version
=3D"color: rgb(0, 0, 0);">Server version: Apache/2.0.58
color: rgb(0, 0, 0);">
Server built:   Dec 12 2006 21:41:=
17

);">Server version: Apache/2.0.58 n>

Server built:   Dec 12 2006 21:41:=
17
0);">Server's Module Magic Number: 20020903:12
r: rgb(0, 0, 0);">
Server loaded:=A0 APR 0.9.12, APR-UTIL=
0.9.12
0, 0, 0);">Compiled using: APR 0.9.12, APR-UTIL 0.9.12
olor: rgb(0, 0, 0);">
Architecture:   32-bit
tyle=3D"color: rgb(0, 0, 0);">Server c=
ompiled with....
lor: rgb(0, 0, 0);">=A0-D APACHE_MPM_DIR=3D"server/mpm/prefork" span>

=A0-D APR_HAS_SENDFILE
=3D"color: rgb(0, 0, 0);">=A0-D APR_HA=
S_MMAP
, 0, 0);">=A0-D APR_HAVE_IPV6 (IPv4-mapped addresses enabled)
le=3D"color: rgb(0, 0, 0);">
=A0-D APR_USE_SYSVSEM_SERIALIZE=

=A0=
-D APR_USE_PTHREAD_SERIALIZE
style=3D"color: rgb(0, 0, 0);">=A0-D SINGLE_LISTEN_UNSERIALIZED_ACCEPT an>

=A0-D APR_HAS_OTHER_CHILD
yle=3D"color: rgb(0, 0, 0);">=A0-D AP_=
HAVE_RELIABLE_PIPED_LOGS
le=3D"color: rgb(0, 0, 0);">=A0-D HTTPD_ROOT=3D"/usr"
tyle=3D"color: rgb(0, 0, 0);">
=A0-D SUEXEC_BIN=3D"/usr/sbin/sue=
xec2"
gb(0, 0, 0);">=A0-D DEFAULT_PIDLOG=3D"/var/run/httpd.pid"<=
br style=3D"color: rgb(0, 0, 0);">
=A0-D DEFAULT_SCOREBOARD=3D"logs/=
apache_runtime_status"
style=3D"color: rgb(0, 0, 0);">=A0-D DEFAULT_LOCKFILE=3D"/var/run/acce=
pt.lock"

=A0-D DEFAULT_ERRORLOG=3D"logs/er=
ror_log"
: rgb(0, 0, 0);">=A0-D AP_TYPES_CONFIG_FILE=3D"/etc/apache2/mime.types=
"

=A0-D SERVER_CONFIG_FILE=3D"/etc/=
apache2/httpd.conf"

=3D"color: rgb(0, 0, 0);">Compiled in =
modules:

=A0 core.c
gb(0, 0, 0);">=A0 prefork.c
style=3D"color: rgb(0, 0, 0);">=A0 htt=
p_core.c

=A0 mod_so.c
rgb(0, 0, 0);">


iv class=3D"gmail_quote">On Thu, Dec 17, 2009 at 10:22 PM, Daniel Reinhardt=
<cryptodan=
@cryptodan.net> wrote:

204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">

name=3D"Compose message area">

; font-weight: normal; font-size: 10pt; line-height: normal; font-size-adju=
st: none; font-stretch: normal;">

-background-clip: -moz-initial; -moz-background-origin: -moz-initial; -moz-=
background-inline-policy: -moz-initial;">

From: il.com" target=3D"_blank">gary lim

Sent: 17 December, 2009 5:05

To: tpd.apache.org" target=3D"_blank">users@httpd.apache.org

Subject: Re: [users@httpd] Apache intermittent crash -=20
HELP!!!

Hi daniel,

1. the intermittent crash happens even bef=
ore=20
we did any performance tuning of the apache.

2. the reason why we di=
d the=20
tuning is because we want to limit the apache memory usage which previously=
was=20
due to apache using up all the swap mem causing the=20
crash.

rgds

On Thu, Dec 17, 2009 at 12:42 PM, Daniel Reinhar=
dt < =3D"_blank">cryptodan@cryptodan.net>=20
wrote:

0pt 0pt 0.8ex; padding-left: 1ex;" class=3D"gmail_quote">-->From: gary =
lim
-->Sent: 16 December, 2009=20
16:20
-->To: lank">users@httpd.apache.org
-->Subject: [users@httpd]=20
Apache intermittent crash - HELP!!!
-->
-->
-->Dear all=
,=20

-->
-->1. I'm using Linux 2.6.16.29 and running on=
=20
i686 Intel(R) Pentium(R) 4 CPU 3.00GHz GNU/Linux
-->2. The below in=
fo=20
are my machine config and log output
-->3. Kindly advise how to res=
olve=20
intermittent apache crash even after performance=20
tuning

-->
-->apache2 error log=20

-->*** glibc detected *** /usr/sbin/apache2: double free=20
or corruption (fasttop): 0x08b4faf0 ***
-->[Tue Dec 15 13:04:22 200=
9]=20
[error] server reached MaxClients setting, consider raising the MaxClient=
s=20
setting
-->*** glibc detected *** /usr/sbin/apache2: double free or=
=20
corruption (fasttop): 0x086a1170 ***
-->*** glibc detected ***=20
/usr/sbin/apache2: double free or corruption (fasttop): 0x08b48c08=20
***

Gary,

What version of glibc do you have?=
=20
=A0The glibc detected could be causing this since its producing a dump=20
code. =A0I would revert back to a default setup with your httpd.conf file=
,=20
and just use the basics you need for your site to run. =A0If you get no=
=20
crashes then its an issue with your performance=20
tuning.

Thanks,
Daniel

------------------------------------------------------------ ----=
-----
The=20
official User-To-User support forum of the Apache HTTP Server Project. >See=20
<URL: CTRL + Click to follow link" href=3D"http://httpd.apache.org/userslist.html=
" target=3D"_blank">http://httpd.apache.org/userslist.html> for more=
=20
info.
To unsubscribe, e-mail: d.apache.org" target=3D"_blank">users-unsubscribe@httpd.apache.org
=
=A0" =A0 from=20
the digest: target=3D"_blank">users-digest-unsubscribe@httpd.apache.org
For addi=
tional=20
commands, e-mail: =3D"_blank">users-help@httpd.apache.org

>

Gary,

=A0

If your application is using all of the SWAP me=
mory=20
maybe its time to rebuild the system with more swap space or upgrade the=20
RAM.=A0 Can you post the server specs for us?=A0 I have never seen an=20
application take full use of all the memory and all the allocated swap=20
space.=A0 You have hardware issues that need to be dealt with before=20
attempting to solve the software ones.

=A0

When you list your system specs, can you also t=
ell us if=20
your Kernel has support for higher memory system configs?

=A0

Thanks,

Daniel